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(54) STEREOSCOPIC VIDEO DISPLAY DEVICE 
(57) Abstract: 

PROBLEM TO BE SOLVED: lb provide a stereoscopic video display device which 
displays a natural stereoscopic video which causes less fatigue of eyes. 
SOLUTION: A focus measuring instrument 1 detects the visual distance from eyes to a 
gaze point. An image generator 2 generates display data of an image subjected to out- 
of-focus processing based on image data of an original image consisting of plural picture 
elements, distance data of each picture element, and the visual distance. A display 
element 3 displays an image based on display data. An eyepiece optical system 4 project 
the displayed image as a virtual image. A projection distance varying mechanism 5 
controls the projection distance of the virtual image so that the virtual image is 
projected in the position of the gaze point. 
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[Claim(s)] 

[Claim 1] The image data of the subject-copy image which consists of two or more pixels, 
and the distance data about each pixel of said subject-copy image, since - based on the 
indicative data of the generated image with a detection means to be equipment which 
displays 3-dimensional scenography and to detect the sight from an observer's eye to a 
fixation point An image generation means to generate the indicative data of the image 
with which pin dotage processing was performed to the sight list detected with this 
detection means based on said image data and distance data, An image display means 
to display an image based on the indicative data generated with this image generation 
means, The solid graphic display device characterized by having an image projection 
means to project the image displayed with this image display means as a virtual image, 
and the control means which controls the projection distance of a virtual image so that 
said virtual image is projected on the location of said fixation point. 
[Claim 2] Said image generation means calculates the amount of pin dotage about each 
pixel of said subject-copy image from said distance data and said sight in generation of 
said indicative data. The distance data about said each pixel are compared with the 
distance data about the circumference pixel located in the field equivalent to said 
amount of pin dotage of the pixel. The solid graphic display device according to claim 1 
characterized by processing to the indicative data of said circumference pixel so that the 
pixel may become pin dotage only about the pixel which has distance data near [ pixel / 
said / circumference 1 an observer. 

[Claim 3] A detection means to be equipment which displays 3-dimensional scenography 
and to detect the sight from an observer's eye to a fixation point, An image generation 
means to generate the indicative data of the image with which pin dotage processing 
was performed according to the sight detected with this detection means, The laser light 
source which emits laser light based on the indicative data generated with this image 
generation means, The condenser lens which condenses the laser light emitted from this 
laser light source, A laser scan means to scan the laser light condensed with this 
condenser lens to two-dimensional, and to form a middle image, The solid graphic 
display device characterized by having the eyepiece optical system which projects the 
middle image formed by this laser scan means as a virtual image, and the control means 
which controls the distance between said laser light sources and said condenser lenses 
so that said virtual image is projected on the location of said fixation point. 



[Claim 4] A detection means to be equipment which displays 3-dimensional scenography 
and to detect the refractive power of an observer's eye, A calculation means to compute 
the sight from an observer's eye to a fixation point from the refractive power detected 
with said detection means, An image generation means to generate the indicative data 
of the image with which pin dotage processing was performed according to the sight 
computed with this calculation means, An image display means to display an image 
based on the indicative data generated with this image generation means, The solid 
graphic display device characterized by having an image projection means to project the 
image displayed with this image display means as a virtual image, and the control 
means which controls the projection distance of a virtual image so that said virtual 
image is projected on the location of said fixation point. 

[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the solid graphic display device which 
makes it possible to be used for a head mount display {HMD (head mounted display)} 
etc., for example, to observe 3-dimensional scenography as a virtual image about a solid 
graphic display device. 
[0002] 

[Description of the Prior Art] The conventional HMD projects the virtual image for - left 
eyes for right eyes on a certain decided distance, and it is constituted so that 3- 
dimensional scenography may be displayed based on binocular parallax. Since the focal 
regulation function of man's eye is disregarded according to this composition,, if long 
duration 3-dimensional scenography is observed, the problem that an eye gets tired will 
occur. The solid graphic display device aiming at solving this problem is proposed by 
JP, 6- 235885, A. By detecting the direction of a look of both eyes, this equipment asked 
for the eyeball congestion location, and has taken the configuration which projects a 
virtual image on that eyeball congestion location. 

[0003] Moreover, HMD of a laser scanning-type (the so-called retina direct writing type) 
is proposed by U.S. Pat. No. 5,355,181 as other equipments which display 3-dimensional 
scenography. According to this equipment, the display of 3-dimensional scenography is 
performed by performing focusing based on the distance data about each pixel of an 
image at high speed, performing a laser scan. 
[0004] 

[Problem(s) to be Solved by the Invention] lb compensate for change of the congestion 
location of right-and-left both eyes, it carries out regulating automatically of the image 



formation location of a display image to the equipment proposed by JP, 6-235885, A, and 
the principle of making an image formation location in agreement with an eyeball 
congestion location is adopted as it. However, since there is variation in the 
interpupillary distance by individual human being, it is difficult to ask for an observer's 
eyeball congestion location correctly. And if image formation justification of a display 
image becomes incorrectness, an eyeball congestion location and an image formation 
location will not be in agreement, and the problem that an eye fatigue-comes to be easy 
conversely will occur. 

[0005] By the way, when the body of a short distance placed before the far background 
with the solid graphic display device is seen, it is desirable for the edge of the body of 
this side which the profile carried out distinctly before the blurred background to be 
able to be seen clearly. However, according to the equipment proposed by U.S. Pat. No. 
5,355,181, the image of the background which faded on the edge of a front body will be 
visible to the condition of having entered and overlapped. For this reason, 3- 
dimensional scenography becomes unnatural and the problem that a sense of reality is 
spoiled occurs. 

[0006] It is made in order that this invention may solve the above troubles, and the 
purpose is in offering the solid graphic display device which can display natural 3- 
dimensional scenography with little fatigue of an eye. 
[0007] 

[Means for Solving the Problem] In order to attain the above-mentioned purpose, the 
solid graphic display device of the 1st invention The image data of the subject-copy 
image which consists of two or more pixels, and the distance data about each pixel of 
said subject-copy image, since - based on the indicative data of the generated image 
with a detection means to be equipment which displays 3-dimensional scenography and 
to detect the sight from an observer's eye to a fixation point An image generation means 
to generate the indicative data of the image with which pin dotage processing was 
performed to the sight list detected with this detection means based on said image data 
and distance data, An image display means to display an image based on the indicative 
data generated with this image generation means, It is characterized by having an 
image projection means to project the image displayed with this image display means as 
a virtual image, and the control means which controls the projection distance of a 
virtual image so that said virtual image is projected on the location of said fixation 
point. 

[0008] The solid graphic display device of the 2nd invention is set in the configuration of 
invention of the above 1st. Said image generation means In generation of said indicative 



data, the amount of pin dotage about each pixel of said subject-copy image is calculated 
from said distance data and said sight The distance data about said each pixel are 
compared with the distance data about the circumference pixel located in the field 
equivalent to said amount of pin dotage of the pixel Only about the pixel which has 
distance data near [ pixel / said / circumference ] an observer, it is characterized by 
processing to the indicative data of said circumference pixel so that the pixel may 
become pin dotage. 

[0009] A detection means for the solid graphic display device of the 3rd invention to be 
equipment which displays 3-dimensional scenography, and to detect the sight from an 
observer's eye to a fixation point, An image generation means to generate the indicative 
data of the image with which pin dotage processing was performed according to the 
sight detected with this detection means, The laser light source which emits laser light 
based on the indicative data generated with this image generation means, The 
condenser lens which condenses the laser light emitted from this laser light source, A 
laser scan means to scan the laser light condensed with this condenser lens to two- 
dimensional, and to form a middle image, It is characterized by having the eyepiece 
optical system which projects the middle image formed by this laser scan means as a 
virtual image, and the control means which controls the distance between said laser 
light sources and said condenser lenses so that said virtual image is projected on the 
location of said fixation point. 

[0010] A detection means for the solid graphic display device of the 4th invention to be 
equipment which displays 3-dimensional scenography, and to detect the refractive 
power of an observer's eye, A calculation means to compute the sight from an observer's 
eye to a fixation point from the refractive power detected with said detection means, An 
image generation means to generate the indicative data of the image with which pin 
dotage processing was performed according to the sight computed with this calculation 
means, An image display means to display an image based on the indicative data 
generated with this image generation means, It is characterized by having an image 
projection means to project the image displayed with this image display means as a 
virtual image, and the control means which controls the projection distance of a virtual 
image so that said virtual image is projected on the location of said fixation point. 
[0011] 

[Embodiment of the Invention] Hereafter, the solid graphic display device which carried 
out this invention is explained, referring to a drawing, in addition, the image data of the 
subject-copy image which changes from two or more pixels to the display of the 3- 
dimensional scenography by the gestalt of this operation and the distance data about 



each pixel of a subject-copy image - since - although the indicative data of the 
generated image is used, the above-mentioned image data and distance data are 
standardly generated by the hardware of existing equipment, and software so that it 
may mention later. 

[0012] Display principle ( drawing 1 - drawing 4 )» of «3-dimensional scenography 
The display principle of 3-dimensional scenography adopted as the gestalt of this 
operation is explained first, the relation between the display object (an apple and tree) 
with which Observer P is looking at drawing 1 , and the projection distance LI and L2 - 
- being shown , drawing 2 (a) ~ therefore, the prepared subject-copy image (there shall 
be no pin dotage covering the whole surface in this subject-copy image) is shown. The 
case where Observer P observes the apple in this subject-copy image and a wooden 
image is considered. When performing a three dimentional display the distance from 
Observer P to an apple and the distance to a tree differ, and are in sight, in order to 
observe natural 3-dimensional scenography gentle to Eye E, it is necessary to change 
the projection distance of a virtual image according to the distance (namely, Observer's 
P sight) which is [ of Observer's P eye E J to the point. Then, when the distance from 
Observer P to an apple is [ the distance from Observer P to a tree ] 50m in 2m, when Eye 
E has doubled the focus with the apple, a virtual image SI is moved so that projection 
distance (LI) may be set to 2m, and when Eye E has doubled the focus with the tree, a 
virtual image S2 is moved so that projection distance (L2) may be set to 50m. 
[0013] The image processing for raising a cubic effect to the image projected on 
coincidence at this time is performed. That is, while the image processing which shows 
an apple distinctly and obscures wooden one is performed as it is shown in drawing 2 (b), 
while Observer P is looking at the apple of 2m beyond, and Observer P is looking at the 
tree of 50m beyond, the image processing which shows a tree clearly and obscures an 
apple as shown in drawing 2 (c) is performed. Thus, when the 2 more than display object 
with which the distance from Observer P differs exists in a subject-copy image, 3- 
dimensional scenography with natural depth perception is constituted by detecting far 
and near relation (that is, distance data) about the pixel which constitutes each display 
object, and indicating the display object which Observer P is not seeing by pin dotage. 
[0014] Furthermore, when it approaches or overlaps and an apple and a tree are 
observed, the following image processings are performed Drawing 3 shows the image 
which the apple and the tree approached, and drawing 4 shows the image which the 
apple and the tree overlapped. In drawing 3 and drawing 4 , (a) is a subject-copy image, 
(b) is an image when Observer P is looking at the apple, and (c) is an image when 
Observer P is looking at the tree. 



[0015] While Observer P is looking at the apple of 2m beyond, as shown in the part El 
in drawing 3 (b) and drawing 4 (b), a pin dotage image which is observed without the 
edge of Thurs. by which the distant view faded lapping with the apple which the close- 
range view carried out distinctly is generated While Observer P is looking at the tree of 
50m beyond, as shown in the part E2 in drawing 3 (c) and drawing 4 (c), a pin dotage 
image with which the edge of the apple with which the close-range view faded is 
observed by lapping with the tree which the distant view carried out distinctly is 
generated. Thus, when it approaches or overlaps and two or more display objects with 
which the distance from Observer P differs are observed, 3-dimensional scenography 
with still more natural depth perception is constituted by performing the display 
overlapped only when the display object which detects and carries out pin dotage of the 
far and near relation (that is, distance data) about the pixel which constitutes each 
display object was in this side. 

[0016] Basic configuration / display procedure ( drawing 5 R> 5, drawing 6 )» of the 
gestalt of «operation Next, the fundamental configuration of the solid graphic display 
device which carried out this invention is explained about a one eye side. The main 
components are the focal measuring device 1, image generation equipment 2, a display 
device (two-dimensional display devices, such as a liquid crystal panel) 3, the eyepiece 
optical system 4, and the projection distance adjustable device 5, as shown in drawing . 
5. 

[0017] The focal measuring device 1 is a detection means which detects the refractive 
power of Observer's P eye E, is based on the refractive power, and computes and outputs 
the sight (location c f a fixation point with which in other words Eye E has doubled the 
focus) from Eye E to a fixation point. From the detected sight, it can know what m 
beyond Observer P is looking at. 

[0018] Image generation equipment 2 is an image generation means to generate 
indicative-data C (n) of the image with which pin dotage processing mentioned later was 
performed based on the sight, the image data, and distance data which were detected 
with the focal measuring device 1. A display device 3 is an image display means to 
display an image based on indicative-data C (n) generated with image generation 
equipment 2. 

[0019] The eyepiece optical system 4 is an image projection means to project the image 
displayed by the display device 3 as a virtual image. The projection distance adjustable 
device 5 is a control means which is autofocus and controls the projection distance L of a 
virtual image, as a virtual-image location is moved to distance, without changing the 
field angle and location of a display object (for example, an apple and a tree) in a 



subject-copy image and said virtual image is projected on the location of the fixation 
point of Eye E. 

[0020] The basic algorithm shown in drawing 6 shows the display procedure performed 
vising the above-mentioned component. First, the focal measuring device 1 detects the 
sight of Eye E ($10). the detected sight and the distance data about each pixel of a 
subject-copy image - since — the pin dotage degree (the amount of pin dotage) of each 
pixel is computed, pin dotage processing is performed to the image data of a subject- 
copy image based on the result, and the indicative data of an image is generated ($20). 
And the indicative data of the image with which pin dotage processing was performed is 
displayed by the display device 3, the image is projected as a virtual image by the 
eyepiece optical system 4, and the virtual image is projected on the location of a fixation 
point by the projection distance adjustable device 5 ($30). 

[00211 « stupor image processing ( drawing 7 - drawing 12 )» Next, the pin dotage 
processing performed by image generation equipment 2 ( drawing 5 ) is explained The 
subject-copy image which consists of the pixel of N individual is prepared, the number of 
No. 1-N is given to each pixel, and the number of the pixel of arbitration is set to n. 
Distance data B (n) , which express the distance from Pupil EP to a display object as 
image data A (n) which consists of color information, brightness information, etc. about 
each pixel n of a subject-copy image are contained in the image {each (a) of drawing 2 - 
drawing 4 } of a subject-copy image, for example, when displaying the apple shown in 
drawing 7 , the color information on the apple to display and brightness information are 
stored in image data A (n), and the distance information of 2m is stored in distance data 
B (n) — {— however, let the value of B (n) be as large a thing as distance being large 
(for). }• 

[0022] In the process ( drawing 8 ) of pin dotage processing, indicative-data C (n) 
computed from the projection distance (namely, sight of Eye E) L of data A (n), B (n), and 
a virtual image is used for the image display by the display device 3. Pin dotage 
processing for computing this indicative-data C (n) is performed one by one about all the 
pixels 1 of a subject-copy image - N so that it may mention later ( drawing 9 R> 9). in 
addition, data A (n) and C (n) — general - the three primary colors (R, G, B) - it can 
express with each brightness information. 

[0023] Below, the procedure of the pin dotage processing about Pixel n is explained 
based on the flow chart of drawing 9 . In addition, the information on brightness zero 
shall be inputted into C (n) before pin dotage processing as initial value. First, after 
initializing a pixel number (#10, n= 1), the amount rn of dotage of the image about Pixel 
n is computed (#20). 



[0024] Here, the calculation approach of the amount rn of dotage is explained based on 
drawing 10 . Each sign in drawing 10 is defined as follows. 
I: The image surface on the retina of Observer's P eye E. 
EP: The pupil of Observer's P eye E. 
r: The radius of Observer's P pupil EP. 

S: The virtual-image side observed through the eyepiece optical system 4. 
R: The radius of the dotage image in the virtual-image side S. 

OP: The object point which has arranged spatially the pixel n which is going to calculate 
the amount rn of dotage. 

H: Distance from Observer's P pupil EP to the object point OP (distance data B (n)). 

L: Distance from Observer's P pupil EP to the virtual-image side S (focal measuring 

device 1). 

[0025] When the object point OP is an ideal point, the magnitude of dotage of the object 
point OP observed in the virtual-image side S is expressed with radius: R= | rx(H-L)/H | 
of the dotage image in the virtual-image side S. If this is changed to an include-angle 
display (radian), it will become magnitude (radius):rn= 1 2r (H-L) / LH I of the amount of 
dotage (radian). Here, about the radius r of the pupil EP in actual count, Observer's P 
actual pupil diameter may be measured and the numeric value (for example, 1mm. - 
5mm) decided beforehand may be used. 

[0026] The flow chart of drawing 9 is asked for return and the field which overlaps the 
pixel (henceforth a "circumference pixel") to which the dotage about Pixel n is located 
around it (#30). As shown in drawing 11 , Eye E is placed near the focal location of the 
eyepiece optical system 2 (f: focal distance), and when the optical system constituted so 
that the image on a display device 3 might be observed is considered, the distance p on a 
display device 3 is equivalent to p/f (radian) seemingly. Then, as shown in drawing 12 , 
the distance to the pixel of the arbitration located around it from Pixel n defines at 
intervals of [ of the core of Pixel n, and the core of the pixel of the above-mentioned 
arbitration ] d, and the circumference pixel which is in the location which fi11« 
formula: d/f<rn further defines as the circumference pixel located in the field (namely, 
field equivalent to the amount of pin dotage) where Pixel n carries out pin dotage, and 
the dotage overlaps the pixel of the above-mentioned arbitration. It asks for the number 
of the circumference pixel applicable to this definition, and is referred to as the 
circumference pixel x (1), x (2), --, x (m) at order from the one where a number is 
younger, m step # pixel [ which were called for by 40 after initializing the circumference 
pixel number k (k= 1) / circumference ] x (1) - of drawing 9 — the following processings 
(#50-#100) are performed to x (m) in an order from x (1) about x (m). 



[0027] It judges whether the circumference pixel x (k) is the same as Pixel n (#50). When 
the circumference pixel x (k) differs from Pixel n, distance data [ of the pixel n made to 
overlap the distance data B (x (k)) of the circumference pixel x (k) located around Pixel 
n ] B (n) is compared (#70). In this judgment (#70), after restricting the digit count of 
distance data so that the overlap of dotage as shown in drawing 3 (c) and drawing 4 (c) 
may occur, {when [ for example, ] the difference of the distance of B (x (k)) and B (n) is 
10mm or less} when B (x (k)) and B (n) are the almost same values, the comparison 
operation of distance data is performed. A limit of the digit count of distance data is 
performed by omitting a digit 10mm or less. 

[0028] Step # When it judges with the pixel n being in this side from the circumference 
pixel x (k) by 70, [the brightness information/m] of A (n) are added to {the case of B(x (k)) 
>=B (n)}, and the brightness information of C (x (k)) in three primary colors (#80). 
Thereby, the brightness of Pixel n is distributed by homogeneity at circumference pixel 
x(l) -x(m) which is m pieces, that is, -- here - the brightness information of image data 
A (n) - the circumference pixel x (1) - m circumference pixel [ which carried out pin 
dotage by dividing by the number (m) of x (m), and adding ] x (1) - it is made to become 
the same as the brightness of image data [ of even if x (m) gathers ] A (n) By this 
processing, as shown in drawing 3 (c) and drawing 4 (c), the image to which dotage of an 
apple entered and overlapped the wooden edge will be observed. 

[0029] On the other hand, when it judges with the circumference pixel x (k) being in this 
side from Pixel n by step #70, {the case of B(x (k)) <B (n)} and C (x (k)) are not changed 
By not changing C (x (k)), as shown in drawing 3 (b) and drawing 4 (b), the edge of the 
apple which the profile carried out distinctly in front of the blurred tree will be observed 
clearly. Thus, only when the direction of the pixel n which is going to carry out pin 
dotage sees from Observer P and is located in this side from the circumference pixel x 
(k) which has not carried out pin dotage of the basis, it is made for the overlap { drawing 
3 (c) and drawing 4 (c)} of dotage to occur. 

[0030] Step # By the judgment of 50, when the same as Pixel n, the circumference pixel 
x (k) does not need to compare distance data, and adds [the brightness information/m] of 
A (n) to C (n) already stored (#60). Step # The above-mentioned processing (#50-#100) is 
repeated until it becomes k=m by 90, and indicative-data C (n) is generated about all 
the pixels from 1 to N by repeating the above-mentioned processing (#20-#120) until it 
becomes n=N by step #110. Based on obtained indicative-data C (n), image display is 
performed by the display device 3, and the image which pin dotage generated through 
the eyepiece optical system 4 is observed by Observer P. 

[0031] Image generation equipment 2 as mentioned above, the amount rn of pin dotage 



about each pixel of a subject-copy image { each (a) of drawing 2 - drawing 4 } Ask from 
distance data B (n) and Sight L (#20), and the distance data B (x (k)) about distance 
data [ about each pixel n ] B (n) and the circumference pixel x (k) are compared (#70). It 
has processed to indicative-data C (x (k)) of the circumference pixel x (k) so that the 
pixel n may become pin dotage from the circumference pixel x (k) only about the pixel n 
which has distance data B (n) near Observer P (#80). In this processing (#80), the 
brightness information of image data A (n) is distributed to two or more circumference 
pixels x (k) decided based on Sight L and distance data B (n), and this processing (#80) 
is not performed about the pixel n which has distance data B (n) far from Observer P 
from the circumference pixel x (k). Thus, the cubic effect of 3-dimensional scenography 
can be raised by performing pin dotage processing to image data A (n) generated 
beforehand and distance data B (n). 

[0032] Image data A (n) used for the above-mentioned pin dotage processing and 
distance data B (n) are used for more various solid graphic display than before. For 
example, the image incorporated with the three-dimension scanner has distance data of 
each pixel which constitutes an image with image data. According to the gestalt of this 
operation, the 3-dimensional scenography observation also with such natural images is 
possible. Moreover, in the computer which generates 3D-Graphics, or the game machine, 
the distance data of each pixel are generated in the process which generates image data, 
and the distance data is stored in the memory called Z-uffer. Therefore, according to the 
gestalt of this operation, it is possible to observe natural 3-dimensional scenography 
taking advantage of the hardware of those existing equipments and software. 
[0033] Optical configuration ( drawing 13 R> 3)» of «laser scanning HMD The optical 
configuration of HMD of a laser scanning-type which carried out this invention to 
drawing 13 is shown. This HMD is equipped with the display unit 10 which constitutes 
an image display means and a control means, the half mirror 16 and concave mirror 17 
which constitute an image projection means (eyepiece optical system), and the infrared 
transparency filter 18 and the focus detection unit 19 which constitute a detection 
means. And the laser scanner 14 grade is used as an image display means instead of the 
two-dimensional display device 3 ( drawing 5 ) in the solid graphic display device 
mentioned above. 

[0034] The display unit 10 consists of the condenser lens 12 which condenses the laser 
light emitted from the laser light source (a driver is included.) 11 which emits laser light 
based on the indicative data generated with image generation equipment 2 ( drawing 5 
R> 5), and the laser light source 11, focusing equipment (for example, it consists of a 
linear motor etc.) 13, the laser scanner (for example, it consists of a polygon mirror, a 



galvanomirror, etc.) 14, and the half mirror 15. An image display means to perform 
image display based on an indicative data consists of the laser light source 11, a 
condenser lens 12, a laser scanner 14, and a half mirror 15. Moreover, the control means 
which controls the distance between the laser light source 11 and a condenser lens 12 so 
that a virtual image is projected on the location of the fixation point of Eye E consists of 
a condenser lens 12 and focusing equipment 13. 

[0035] The laser light from the laser light source 11 turns into convergence light with a 
condenser lens 12, and penetrates a half mirror 15. It is combined with focusing 
equipment 13 and a condenser lens 12 is driven in the direction of an optical axis 
according to the control signal from focusing equipment 13. The laser light which 
penetrated the half mirror 15 is scanned by two-dimensional with the laser scanner 14, 
and a middle image is formed. It is reflected by the half mirror 15 and the laser light 
which came out of the laser scanner 14 faces to a half mirror 16. And after it is reflected 
with a half mirror 16 and a concave mirror 17 and laser light penetrates a half mirror 
16, it is led to the location of Observer's P pupil EP. 

[0036] Thus, the eyepiece optical system which consists of a half mirror 16 and a 
concave mirror 17 projects the middle image formed by the laser scanner 14 as a virtual 
image. The reflector of a concave mirror 17 has constituted the shape of the spherical 
surface centering on a pupil EP location mostly, and the laser scanner 14 is arranged in 
the location almost equivalent to the spherical-surface core of the reflector of a concave 
mirror 17. Moreover, although a spherical-surface-like middle image is mostly formed of 
the display unit 10, the middle image and reflector of a concave mirror 17 are this 
alignment mostly. 

[0037] The focus detection unit 19 arranged at the half mirror 16 bottom projects an 
infrared index on the retina of Eye E, detects the situation of the focus of Eye E by 
measuring the contrast, and has become the structure which acquires a sight from the 
detection result. Although the optical path from the focus detection unit 19 to Eye E is 
bent by the half mirror 16, in order to avoid the laser light which carries out direct 
incidence from the display unit 10 to the focus detection unit 19 through a half mirror 
16, the infrared transparency filter 18 which makes only infrared radiation penetrate 
between a half mirror 16 and the focus detection unit 19 is arranged. A noise can be 
reduced with this infrared transparency filter 18. 

[0038] Although focusing is performed by moving a condenser lens 12 with focusing 
equipment 13, even if it adjusts a virtual-image location by focusing, the magnitude 
(image point location on a retina) of the appearance of the image decided by the scan 
include angle of the laser scanner 14 does not change. Thus, since a virtual-image 



location can be adjusted without changing the magnitude of an image by moving the 
small condenser lens 12, the whole solid graphic display device can be made very small 
Moreover, although this HMD has composition which equipped the display unit 10 with 
the laser light source 11, the display unit 10 is possible also for attaining colorization of 
a solid graphic display device by preparing a light source unit independently, inputting 
the light (R, G, B) from the three laser light sources into a fiber, and arranging the 
output side end face of a fiber in the light source location in drawing 13 . 
[0039] When two-dimensional display devices (liquid crystal panel etc.) like a display 
device 3 ( drawing 5 ) are used, in order to change the projection distance L, a display 
device 3 and the eyepiece optical system 4 will be moved. Since size is comparatively 
large, these components are not easy to maintain and move sufficient precision. 
Moreover, when changing spacing of a display device 3 and the eyepiece optical system 4, 
in order to make it degradation of the image by aberration not take place, complicated 
optical system is needed. Since it will end if the display which displays by laser scan is 
used as shown in drawing 13 , and a comparatively small component is moved like the 
laser light source 11 or a condenser lens 12, the projection distance L can be more easily 
changed with a sufficient precision. And since the eyepiece optical system 4 ( drawing 
5 ) consists of the half mirror 16 and the concave mirror 17, in spite of being an easy 
configuration, projection without image degradation is possible. 

[0040] Concrete configuration ( drawing 14 )» of the «binocular vision HMD Fig. 1414 
shows the appearance of HMD which constituted Above HMD ( drawing 13 ) in 
binocular visions. This HMD equips right-and-left both eyes with the observation 
optical system which consists of the display unit 10, a half mirror 16, and a concave 
mirror 17, respectively, and observation of 3-dimensional scenography is attained. The 
focus detection unit 19 is formed only in the right eye side, focusing equipment 13 is 
controlled based on the signal from this focus detection unit 19, and focusing of right- 
and-left both eyes is performed. Moreover, pin dotage processing mentioned above is 
performed based on the signal from the focus detection unit 19, and the signal from 
image generation equipment 2. 
[0041] 

[Effect of the Invention] Since a virtual image is projected on an observer's fixation 
point location according to the 1st - the 4th invention as explained above, it is effective 
in that there is little fatigue of an observer's eye. Moreover, since pin dotage processing 
according to a sight is performed to an image, observation of natural 3-dimensional 
scenography with presence is possible. 

[0042] Since the natural depth perception that the foreground distinctly made into the 



background which carried out pin dotage can be seen is obtained according to the 2nd 
invention, it is possible to observe the 3-dimensional scenography whose presence 
increased further. It is effective in the fatigue at the time of 3-dimensional scenography 
observation being further mitigated by this natural depth perception display. 
[0043] Since the condenser lens to which it is made to move for focusing for example can 
be miniaturized according to the 3rd invention, the whole equipment can be made very 
small Moreover, only projection distance can be changed, without generating a location 
gap of the projection image on a retina in focusing, since eyepiece optical system can be 
constituted from a spherical mirror, a half mirror, etc. And the good image formation 
engine performance can be obtained over the whole surface of a virtual image. 

[Brief Description of the Drawings] 

[Drawing 1] The mimetic diagram for explaining the display principle adopted as the 
solid graphic display device which carried out this invention. 

[Drawing 2] Drawing showing the subject-copy image in drawing 1 , and the image 
observed. 

[Drawing 3] Drawing showing the generating condition of the pin dotage image about a 
subject-copy image that the display object approached. 

[Drawing 4] Drawing showing the generating condition of the pin dotage image about 
the subject-copy image which the display object overlapped. 

[Drawing 5] The block diagram showing the elemental ingredient of the solid graphic 
display device which carried out this invention. 

[Drawing 6] The flow chart which shows the fundamental algorithm of the solid graphic 
display device which carried out this invention. 

[Drawing 7] Drawing for explaining the image data of a subject-copy image, and 
distance data. 

[Drawing 8] The block diagram for explaining the process of pin dotage processing. 
[Drawing 9] The flow chart which shows the procedure of the pin dotage processing 
performed to an image. 

[Drawing 10] Drawing for explaining calculation of the amount of dotage. 

[Drawing 11] Drawing for explaining the field where the dotage about a certain pixel 

overlaps a circumference pixel. 

[Drawing 12] Drawing for explaining the field where the dotage about Pixel n overlaps 
circumference pixel x(l) -x(m). 

[Drawing 13] the laser scanning- type which carried out this invention - drawing of 
longitudinal section showing the optical configuration of HMD typically. 



[Drawing 14] The perspective view showing typically the appearance configuration of 
the binocular vision HMD which carried out this invention. 
[Description of Notations] 

1 — Focal Measuring Device 

2 Image Generation Equipment 

3 Display Device 

4 Eyepiece Optical System 

5 Projection Distance Adjustable Device 

10 - Display Unit 

11 — Laser Light Source 

12 — Condenser Lens 

13 Focusing Equipment 

14 — Laser Scanner 

15 — Half Mirror 

16 - Half Mirror 

17 — Concave Mirror 

18 — Infrared Transparency Filter 

19 — Focus Detection Unit 
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